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Abstract — Dempster-Shafer evidence theory is very important 
in the fields of information fusion and decision making. However, 
it always brings high computational cost when the frames of 
discernments to deal with become large. To reduce the heavy 
computational load involved in many rules of combinations, the 
approximation of a general belief function is needed. In this paper 
we present a new general principle for uncertainty reduction 
based on hierarchical proportional redistribution (HPR) method 
which allows to approximate any general basic belief assignment 
(bba) at a given level of non-specificity, up to the ultimate level 
1 corresponding to a Bayesian bba. The level of non-specificity 
can be adjusted by the users. Some experiments are provided to 
illustrate our proposed HPR method. 

Index Terms — Belief functions, hierarchical proportional redis- 
tribution (HPR), evidence combination, belief approximation. 

I. Introduction 

Dempster-Shafer evidence theory, also called belief function 
theory [1], is an interesting and flexible tool to deal with 
imprecision and uncertainty for approximate reasoning. It 
has been widely used in many applications, e.g., information 
fusion, pattern recognition and decision making [2], 

Although evidence theory is successful in uncertainty mod- 
eling and reasoning, high computational cost is a drawback 
which is often raised against evidence theory [2], In fact, the 
computational cost of evidence combination increases expo- 
nentially with respect to the size of the frame of discernment 
(FOD) [3] — [5]. To resolve such a problem, three major types 
of approaches have been proposed by he researchers. 

The first type is to propose efficient procedures for perform- 
ing exact computations. For example, Kennes [6] proposed an 
optimal algorithm for Dempster’s rule of combination. Bar- 
nett’s work [7] and other works [8] are also the representatives. 

The second type is composed of Monte-Carlo techniques. 
See details in the paper of Moral and Salmeron [9], 

The third type is to approximate (or simplify) a belief 
function to a simpler one. The papers of Voorbraak [4], Dubois 
and Prade [10] are seminal works in this type of approaches. 
Tessem proposed the famous k — l — x approximation approach 
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[3], Grabisch proposed some approaches [11], which can build 
a bridge between belief functions and other types of uncer- 
tainty measures or functions, e.g., probabilities, possibilities 
and /c-additive belief function (those belief functions whose 
cardinality of the focal elements are at most of k). Based on 
pignistic transformation in transferable belief model (TBM), 
Burger and Cuzzolin proposed two types of fc-additive belief 
functions [12], Denceux uses hierarchical clustering strategy 
to implement the inner and outer approximation of belief 
functions [13], 

In this paper, we focus on the approximation approach of 
belief functions. This first reason obviously is that it can reduce 
the computational cost of evidence combination. Furthermore, 
human find that it is not intuitive to attach meaning to focal 
elements with large cardinality [14]. Belief approximation can 
either reduce the number or the cardinalities of focal elements, 
or both of them can be reduced. Thus by using belief function 
approximation, we can obtain a representation which is more 
intuitive and easier to process. We propose a new method 
called hierarchical proportional redistribution (HPR), which is 
a general principle for uncertainty reduction, to approximate 
any general basic belief assignment (bba) at a given level of 
non-specificity, up to the ultimate level 1 corresponding to a 
Bayesian bba. That is, our proposed approach can generate 
an intermediate object between probabilities and original be- 
lief function. The level of non-specificity can be controlled 
by the users through the adjusting of maximum cardinality 
of remaining focal element. Our proposed approach can be 
considered as a generalized k-additive belief approximation. 
Some experiments are provided to illustrate our proposed 
HPR approach and to compare it with other approximation 
approaches. 

II. Basics in evidence theory 

In Dempster-Shafer evidence theory [1], the frame of 
discernment (FOD) denoted by O is a basic concept. The 
elements in 0 are mutually exclusive. Suppose that 2 e denotes 
the powerset of FOD and define the function m : 2 e -> [0, 1] 
as the basic belief assignment (bba) satisfying: 

4ce = TO ( 0 ) = 0 (1) 
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A bba is also called a mass function. Belief function (Bel) 
and plausibility function (PI) are defined below, respectively: 



Bel{A) = Y JB( - A m{B) 


(2) 


pl(A) = Y m(B) 


(3) 



Suppose that mi, m 2 , m n are n mass functions, Dempster’s 
rule of combination is defined in (4): 



m(A ) 



0, A = 0 

£ I! mi(Ai) 

E TI rni(Ai) 

nAj^0 l<i<n 



A^0 



(4) 



Dempster’s rule of combination is used in DST to imple- 
ment the combination of bodies of evidence (BOEs). 

Evidence theory has been widely used in many application 
fields due to its capability of approximate reasoning and 
processing of uncertain information. However, as referred 
in introduction section, there also exists the drawback of 
high computational cost in evidence combination. Several 
approaches have been proposed accordingly, which includes 
efficient algorithms [6]-[8] for evidence combination, the 
Monte-Carlo techniques and the approach of belief function 
approximation [9], We prefer to use the belief approximation 
approach [10]— [13] to reduce the computational cost needed 
in the combination operation because the approximation ap- 
proach reduces the computational cost and also allow to deal 
with smaller-size focal elements, which is more intuitive for 
human to catch the meaning [14], In the next section, we recall 
some well-known basic approximation approaches. 



III. BBA APPROXIMATION APPROACHES 



1) k — l — x approach: The approach of k — l — x was 
proposed by Tessem [3], The simplified or compact bba 
obtained by using k — l — x satisfies: 

1) keep no less than k focal elements; 

2) keep no more than l focal elements; 

3) the mass assignment to be deleted is no greater than x. 

In algorithm of k—l—x , the focal elements of a original bba 

are sorted according to their mass assignments. Such algorithm 
chooses the first p focal elements such that k < p < l 
and such that the sum of the mass assignments of these 
first p focal elements is no less than 1 — x. The deleted 
mass assignments are redistributed to the other focal elements 
through a normalization. 

2) k-additive belief function approximation: Given a bba 
to : 2 e — > [0,1], the fc-additive belief function [11], [12] 
induced by the mass assignment is defined in Eq.(5). Suppose 
that BC0, 



m k (B)=m(B)+ £ V(M|f) > V|B|<fc 

ADB,ACQ,\A\>k 

mk(B) =0, V \B\ > k 

(5) 

where 



AT(\A\,k) = Yl 



j = 1 



14 



14! 



' J ^ 0 — 1 )!( |4 — i)! 



(6) 



is average cardinality of the subsets of A of size at most k. 

It can be seen that for fc-additive belief approximation, the 
maximum cardinality of available focal elements is no greater 
than k. 

In this section, k — l — x approach and fc-additive belief 
function approximation approach are introduced, which will 
be compared with our proposed approach introduced in next 
section. There also other types of bba approximation approx- 
imation approaches, see details in related references. 



IV. Hierarchical Proportional Redistribution 

APPROXIMATION 



In this paper we propose a hierarchical bba approximation 
approach called hierarchical proportional redistribution (HPR), 
which provides a new way to reduce step by step the mass 
committed to uncertainties. Ultimately an approximate mea- 
sure of subjective probability can be obtained if needed, i.e. 
a so-called Bayesian bba in [1], It must be noticed that this 
procedure can be stopped at any step in the process and thus 
it allows to reduce the number of focal elements in a given 
bba in a consistent manner to diminish the size of the core 
of a bba and thus reduce the complexity (if needed) when 
applying also some complex rules of combinations. We present 
here the general principle of hierarchical and proportional 
reduction of uncertainties in order to obtain approximate bba’s 
at different non-specificity level we expect. The principle of 
redistribution of uncertainty to more specific elements of the 
core at any given step of the process follows the proportional 
redistribution already proposed in the (non hierarchical) DSmP 
transformation proposed recently in [5], Thus the proposed 
HPR can be considered as a bba approximation approach 
inspired by the idea of DSmP. 

Let’s first introduce two new notations for convenience and 
for concision: 

1) Any element of cardinality 1 < fc < n of the power 
set 2 e will be denoted, by convention, by the generic 
notation X(k). For example, if 0 = {A,B,C}, then 
X(2) can denote the following partial uncertainties 
AU B, dUC or B U C, and X (3) denotes the total 
uncertainty A U B U C. 

2) The proportional redistribution factor (ratio) of width n 
involving elements X and Y of the powerset is defined 
as (for X 0 and Y 0) 



Rs{Y, X) = 



m(Y) + e • |X| 

I] rc.Y m(Y) + e-\X\ 

1*1— m=s 



(7) 



where e is a small positive number introduced here to 

deal with particular cases where ^ ycx m(Y ) = 0. 

1*1 — \Y[=s 

By convention, we will denote R(Y,X ) = R\(Y, X) 
when we use the proportional redistribution factors of 
width s = 1. 



The HPR is obtained by a step by step (recursive) proportional 
redistribution of the mass m(X(k)) of a given uncertainty 
X(k) (partial or total) of cardinality 2 < fc < n to all the least 
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specific elements of cardinality k— 1, i.e. to all possible X(k— 
1), until k = 2 is reached. The proportional redistribution is 
done from the masses of belief committed to X (k— 1) as done 
classically in DSmP transformation. The ’’hierarchical” masses 
mh (.) are recursively (backward) computed as follows. Here 
TO/j(fc) represents the approximate bba obtained at the step n—k 
of HPR, i.e., it has the maximum focal element cardinality of 
k. 

Trt' h ( n —i)(X(n 1)) =m(X(n- 1))+ 

Y [m{X(n))-R(X(n-l),X(n))}-, 

X(n)DX(n- 1) 

X(n),X(n- l)e2 e 

m h (n-i)(A) = m(A),M\A\ < n - 1 

( 8 ) 

m h(n- 1 )(') is the bba obtained at the first step of HPR 
(n — (n — 1) = 1), the maximum focal element cardinality 
of is n - 1. 

m h ( n - 2 ){X(n — 2)) = m(X(n- 2))+ 

Y [ m h(n-i){X (n-l))- R(X (n—2) , X (n—l))} 

X(n-l)DX(n-2) 

X(n-2),X(n-l)E2 0 

m h ( n - 2 )(-A) = m h ( n _ 1 )(A),V \A\ <n- 2 

(9) 

m>h(ji— 2 ) (*) is the bb a obtained at the second step of HPR 
(?r — (n — 2) = 2), the maximum focal element cardinality of 

m h { n - 2 ) is n - 2. 

This hierarchical proportional redistribution process can 
be applied similarly (if one wants) to compute m/j(„_ 3 )(.), 
m h ( n - 4 )(.)> m H 2) (-)> m Hi)(-) with 

m h{ 2)(X(2)) = m(X(2))+ 

Y [m m (X(3))-R(X(2),X(3))} 

X(3)DX(2) 

X(3),X(2)e2 0 

m h ( 2 )(A) = 77^(3) (H),V|H| < n — 2 

(10) 

m h( 2 )( - ) is the bba obtained at the first step of HPR (n — 2), 
the maximum focal element cardinality of ?n^( 2 ) is 2. 

Mathematically, for any X(l) £ 0, i.e. any 0, £ 0 a 
Bayesian belief function can be obtained by HPR approach 
in deriving all possible steps of proportional redistributions of 
partial ignorances in order to get 

mh(i)(X( 1)) = m(X( 1))+ 

Y [m H 2)(X(2))-R(X(l),X(2))} (11) 

X(2)DX(1) 

X(l),A'(2)e2 e 



In fact, to/, ,(!)(■) is a probability transformation, called here 
the Hierarchical DSmP (HDSmP). Since X (n) is unique and 
corresponds only to the full ignorance 9\ U 02 U . . . U 9 n , the 
expression of nih(X(n — 1)) in Eq.(10) just simplifies as 

mh(n-i)(X(n - 1)) = m h (X(n - 1))+ 

m(X(n)) ■ R(X(n- l),X(n)) (12) 

Because of the full proportional redistribution of the masses 
of uncertainties to the elements least specific involved in 
these uncertainties, no mass of belief is lost during the step 
by step hierarchical process and thus at any step of HPR, 
the sum of masses of belief is kept to one, and of course the 
Hierarchial DSmP also satisfies ]Cx(i)e 2 e m h(X( 1)) = 1. 

Remark: For some reasons depending of applications, it is 
also possible to easily modify this HPR approach with little 
effort into a constrained HPR version (CHPR for short) by 
forcing the masses of some partial ignorances of cardinality 
k + 1 to be (proportionally) redistributed back only to a subset 
of the partial ignorances of cardinality k included in them. 
This possibility has not be detailed here due to space limitation 
constraint and its little technical interest. 

V. Examples 

In this section we show in details how HPR can be applied 
on very simple different examples. So let’s examine the 
three following examples based on a simple 3D frame of 
discernment 0 = {$i, 02,^3} satisfying Shafer’s model. 

A. Example 1 

Let’s consider the following bba: 

m(0i) = 0.10, m(0 2 ) = 0.17, m(0 3 ) = 0.03, 

m(0r U 0 2 ) = 0.15, m(0i U 0 3 ) = 0.20, 
m(0 2 U 0 3 ) = 0.05, m(0i U 0 2 U 0 3 ) = 0.30. 

We apply the hierarchical proportional redistribution (HPR) 
principle with e = 0 in this example because there is no 
mass of belief equal to zero. It can be verified that the result 
obtained with small positive e parameter remains (as expected) 
numerically very close to that obtained with e = 0. 

The first step of HPR consists in redistributing back m(9 1 U 
02 003 ) = 0.30 committed to the full ignorance to the elements 
0i U 02, 0i U 03 and 02 U 0 3 only, because these elements 
are the only elements of cardinality 2 that are included in 
0i U 02 U 0 3 . Applying the Eq. (8) with n = 3, one gets when 
X(2) = 0i U 02, 0i U 0 3 and 0i U 0 2 the following masses. 

m h(2) (0i U 0 2 ) = m(0i U 0 2 ) + m(X( 3)) • R(9 X U 0 2 , X(3)) 
= 0.15 + (0.30 • 0.375) = 0.2625 

because R(9, U 0 2 , *(3)) = 0 ,i 5+ ^ +0 .o 5 = °- 375 - 
Similarly, one gets 

m h(2 )(0i U 0 3 ) = m(0i U 0 3 ) + m(X( 3)) • R(9 X U 0 3 , X(3)) 
= 0.20 + (0.30 -0.5) = 0.35 
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because R(9 i U 9 3 ,X(3)) = 0 , 15+ o; 2 o +0 .o 5 = °' 5 ’ and also 

m H 2) (0 2 U 0 3 ) = m(0 2 U 0 3 ) + m(X(3)) • R{9 2 U 0 3 , X(3)) 
= 0.05 + (0.30 • 0.125) = 0.0875 

because J?(0 2 U 0 3 ,X( 3)) = 0 . 15+ °;°g +0 , 05 = 0.125. 

Now, we go to the next step of HPR principle and one 
needs to redistribute the masses of partial ignorances X(2) 
corresponding to 9-\ IJ 0 2 , 9\ U 9 3 and 9 2 U 9 3 back to the 
singleton elements X(l) corresponding to ()-\ , 9 2 and 9 3 . We 
use Eq. (11) for doing this as follows: 

m h (i){9i) = m(9\) + m h (9i U 0 2 ) • -R(0i,0i U 0 2 ) 

+ Tfih{0 1 U 9 3 ) ■ R(9i, 9\ U 9 3 ) 

« 0.10 + (0.2625 • 0.3703) + (0.35 • 0.7692) 

= 0.10 + 0.0972 + 0.2692 = 0.4664 

because 

R ^ u «*> = mr<u7* 0 - 3m 

R < 9 '- e ‘ u V = oJ ^* OJ692 

Similarly, one gets 

m h( i)(0 2 ) = m(0 2 ) + m h (9i U 0 2 ) • R(9 2 ,9 1 U 0 2 ) 

+ m h (9 2 U9 3 )-R{9 2 ,9 2 U9 3 ) 

« 0.10 + (0.2625 • 0.6297) + (0.0875 • 0.85) 

= 0.17 + 0.1653 + 0.0744 = 0.4097 

because 

m ’ *1 u « = oFTtuf “ °- 6297 

R(fe ' feu « = iu7TtC03= 0 ' 85 

and also 

m h ^i){9 3 ) = m(0 3 ) + m h (9i U 0 3 ) • f?(0 3 ,0i U 9 3 ) 

+ rrih(9 2 U 0 3 ) • R{9 3 , 9 2 U 0 3 ) 

« 0.03 + (0.35 • 0.2307) + (0.0875 • 0.15) 

= 0.03 + 0.0808 + 0.0131 = 0.1239 



Step 1 



Step 2 

Figure 1 . Illustration of Example 1 



Table I 

Experimental results of HPR for Example 1 . 





m h(k)( ■) - 


approximate baa 




k = 3 


k = 2 


k = 1 


+ 


0.1000 


0.1000 


0.4664 


62 


0.1700 


0.1700 


0.4097 


03 


0.0300 


0.0300 


0.1239 


6 \ U 62 


0.1500 


0.2625 


0.0000 


01 U 0 3 


0.2000 


0.3500 


0.0000 


62 U 63 


0.0500 


0.0875 


0.0000 


61 U 62 U 6 s 


0.3000 


0.0000 


0.0000 



The procedure can be illustrated in Fig. 1 below. The 
approximate bba at each step with different maximum focal 
elements’ cardinality are listed in Table I. 

To compare our proposed HPR with the approach of k — 
l — x, we set the parameters of k — l — x to obtain bba’s 
with equal focal element number with HPR at each step. In 
Example 1, for HPR at first step, it can obtain a bba with 6 
focal elements. Thus we set k = ( = 6, x = 0.4 for k — l — x 
to obtain a bba with 6 focal elements. Similarly, for HPR at 
second step, it can obtain a bba with 3 focal elements. Thus 
we set k = l = 3, x = 0.4 for k — l — x. Based on the approach 
of k — l — x, the results are in Table II. 



Table II 

Experimental results of k — l — x for Example 1 





m(-) obtained by k — l — x 




k = l = 6 


k = l = 3 


01 


0.1031 


0.0000 


02 


0.1753 


0.2573 


03 


0.0000 


0.0000 


01 U 02 


0.1546 


0.0000 


01 U 0 3 


0.2062 


0.2985 


62 U 6 s 


0.0515 


0.0000 


6 \ U 62 U 6s 


0.3093 


0.4478 




because 

R(9 3l 9 x U 0 3 ) = 0:03 « 0.2307 

V 3 ’ 1 3; 0.10 + 0.03 

R(6 3 , 0 2 U 0 3 ) = — = 0.15 

v 3 3; 0.17 + 0.03 

Hence, the result of final step of HPR is: 

m h ( i)(0i) = 0.4664, m h ^(9 2 ) = 0.4097, 

m h (i)(03) = 0.1239. 

We can easily verify that 

m h (i)(8i) + m h{1) (9 2 ) +m h(1) {9 3 ) = 1. 



B. Example 2 

Let’s consider the following bba: 

to(0i) = 0, m(0 2 ) = 0.17, m(0 3 ) = 0.13, 

m(0i U 0 2 ) = 0.20, m(0i U 0 3 ) = 0.20, 

?n(0 2 U 0 3 ) = 0, ?n(0i U 02 U 0 3 ) = 0.30 

The first step of HPR consists in redistributing back m(0i U 
02U0 3 ) = 0.30 committed to the full ignorance to the elements 
0i U 0 2 , and 0i U 0 3 only, because these elements are the only 
elements of cardinality 2 that are included in 0i U 02 U 0 3 . 
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Applying Eq. (8) with n = 3, one gets when X(2) = 9 1 U 0 2 , 
9\ U 0 3 and 0\ U 0 2 the following masses 



m m {0 1 U 0 2 ) = m(0i U 0 2 ) + m(X( 3)) • R{9 1 U 0 2 , X(3)) 
= 0.20 + (0.3- 0.5) = 0.35 



and also 

™ h (i){0 3 ) = m(6 3 ) + m/,(0i U 0 3 ) • R{9 3 ,9 1 U 0 3 ) 
+ Ti%h{9 2 U 0 3 ) • R(9 3 , 0 2 U 0 3 ) 

« 0.13 + (0.35 • 1) + (0.00 • 0.4333) 

= 0.13 + 0.35 + 0.00 = 0.48 



because 

R{9\ U 9 2 ,X(3)) 

Similarly, one gets 



0.20 

0.20 + 0.20 + 0.00 



= 0.5 



m h( 2 ) (0i U 0 3 ) — m(0 1 U 0 3 ) + m(X( 3)) • f?(0i U 9 3 ,X( 3)) 
= 0.20 + (0.3- 0.5) = 0.35 



because 

R(0i U0 3 ,X(3)) 

and also 



0.20 

0.20 + 0.20 + 0.00 



= 0.5 



because 



i?(0 3 ,0iU0 3 ) 



i?(0 3 ,0 2 U0 3 ) = 



0.13 

” 0.13 + 0.00 
0.13 

0.17 + 0.13 ~ 



= 1 
0.4333 



Hence, the result of final step of HPR is 



mh(X){9\) = 0.00, m/,(i)(0 2 ) = 0.52, m h ^){9 3 ) = 0.48 

and we can easily verify that 



TO /i(i)(^i) + m Kl) {6 2 ) + m /l(1) (0 3 ) = 1. 

The HPR procedure of Example 2 with e = 0 is Fig. 2. 



m h(2) (0 2 U 0 3 ) = m(0 2 U 0 3 ) + m(X(3)) • i?(0 2 U 0 3 , X (3)) 
= 0.00 + (0.3- 0.0) = 0.0 



because 

R{02 U9 3 ,X(3)) 



0.0 

0.20 + 0.20 + 0.00 



= 0 



Now, we go to the next step of HPR principle and one 
needs to redistribute the masses of partial ignorances X(2) 
corresponding to 9\ U 0 2 , 0\ U 0 3 and 9 2 U 0 3 back to the 
singleton elements X(l) corresponding to 9\, 9 2 and 0 3 . We 
use Eq. (11) for doing this as follows: 



m ft(i)(0i) = m (9 1 ) +m h (9 1 U 0 2 ) • i?(0i,0i U 0 2 ) 
+ mh{9\ U 0 3 ) • R(9i, 9i U 0 3 ) 
w 0.00 + (0.35 • 0.00) + (0.35 • 0.00) 

= 0.00 + 0.00 + 0.00 = 0.00 



because 



R(9i,9i U 9 2 ) 



0.00 

0.00 + 0.17 



0.00 



R(9i,9i U 0 3 ) 



0.00 

0.00 + 0.13 



0.00 



Step 1 



Step 2 




Figure 2. Illustration of Example 2. 



If one takes e = 0, there is no mass that will be reassigned 
to {02 U 03 } as illustrated in Fig. 2. But if one takes e > 0, 
HPR procedure of Example 2 is the same as that illustrated in 
Fig. 1, i.e., there also exist masses redistributed to {02 U 0 3 } 
as illustrated in Fig. 1. That’s the difference between Fig. 1 
and Fig. 2. 

Suppose that e = 0.001, the HPR calculation procedure is 
as follows. 

The first step of HPR consists in distributing back m{9\ U 
0 2 U0 3 ) = 0.30 committed to the full ignorance to the elements 
0i U 02, 0i U 0 3 and 9 2 U 0 3 . Applying the Eq. (8) with n = 3, 
one gets when X(2) = 9iL)9 2 , 0iU0 3 and 0iU02 the following 
masses 



Similarly, one gets 

mh(i)(9 2 ) = m(0 2 ) +m h (9i U0 2 ) • R{9 2 ,9i U 0 2 ) 
+ 7^(02 U0 3 ) -77(02, 02 U0 3 ) 

« 0.17 + (0.35 • 1) + (0.00 • 0.5667) 

= 0.17 + 0.35 + 0.00 = 0.52 



because 



i?(0 2 ,0iU0 2 ) 



i?(02,0 2 U0 3 ) = 



0.17 

" 0.00 + 0.17 
0.17 

0.17 + 0.13 ~ 



= 1 
0.5667 



m h( 2 ) (9 1 U 02) — m{9\ U 02) + m(X (3)) • R{9\ U 02, -X”(3)) 
= 0.20 + (0.3 • 0.4963) = 0.3489 



because 

i?(0i U 0 2 , 2f(3)) 



0.20 + 0.001-3 

(0.20 + 0.001 • 3) • 2 + (0.00 + 0.001 • 3) 
0.4963 



m h{ 2) (0i U 0 3 ) = m(0i U 0 3 ) + m(X( 3)) • R{9 1 U 0 3 , X(3)) 
= 0.20 + (0.3 • 0.4963) = 0.3489 
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because 

R(9i U 9 2 ,X(3)) 



because 

0.20 + 0.001-3 

(0.20 + 0.001 • 3) • 2 + (0.00 + 0.001 • 3) i?( 6 » 3 , 6 >i U 0 3 ) 

0.4963 



0.13 + 0.001 • 2 

(0.13 + 0.001 • 2) + (0.00 + 0.001 • 2) 
0.9851 



m h{ 2) (0 2 U 0 3 ) = m(9 2 U 0 3 ) + m(X( 3)) • R(9 2 U 9 3 , X(3)) 
= 0.00 + (0.3 • 0.0073) = 0.0022 

because 



R(9 3 , 9 2 U 6 * 3 ) 



0.13 + 0.001 • 2 

(0.17 + 0.001 • 2) + (0.13 + 0.001 • 2) 
0.4342 



R{9 2 U 9 3 , X(3)) = 7 ^ ^ 

(0.20 + 0.001 -3) -2 + (0.00 + 0.001 -3) 

= 0.0073 

Now, we go to the next step of HPR principle and one 
needs to redistribute the masses of partial ignorances X(2) 
corresponding to 9\ U 0 2 , 9\ IJ 0 3 and 0 2 U 9 3 back to the 
singleton elements X(l) corresponding to 9\, 0 2 and 9 3 . We 
use Eq. (11) for doing this as follows: 



Hence, the final result of HPR approximation is 

m H i)(0i) = 0.0092, m. h{1) (9 2 ) = 0.5161, 

m H1) (9 3 ) = 0.4746 

and we can easily verify that 

"i/r(i) (0i ) + ”+»(!) (9 2 ) +m h(1 ){9 3 ) = 1. 



™h(i)(0i) = m(9i) +m h (9 1 U 9 2 ) ■ R{9 1 ,9 1 U 9 2 ) 
+ mh{9\ U 9 3 ) ■ R(9i, 9i U 9 3 ) 



« 0.00 + (0.3489 • 0.0115) + (0.3489 • 0.0149) 
= 0.00 + 0.0040 + 0.0052 = 0.0092 



because 

R(9i,9i U 9 2 ) 



0.00 + 0.001 • 2 

(0.00 + 0.001 • 2) + (0.17 + 0.001 • 2) 
0.0115 



R{9 i,0i U0 3 ) 



0.00 + 0 . 001-2 

(0.00 + 0.001 • 2) + (0.13 + 0.001 • 2) 
0.0149 



The bba’s obtained in each step are listed in Table III (e = 0) 
and Table IV (e = 0.001) 



Table III 

Experimental results of HPR for Example 2 (e = 0 . 001 ) 



Focal elements 


m h(k) (') " approximate baa 


k = 3 


k = 2 


k = 1 


61 


0.0000 


0.0000 


0.0000 


62 


0.1700 


0.1700 


0.5200 


e 3 


0.1300 


0.1300 


0.4800 


6 l U 62 


0.2000 


0.3500 


0.0000 


81 U 63 


0.2000 


0.3500 


0.0000 


0 2 U 63 


0.0000 


0.0000 


0.0000 


61 U 62 U 6 s 


0.3000 


0.0000 


0.0000 



Similarly, one gets 



m h (i)(9 2 ) = rn(0 2 ) +m h (9i U 9 2 ) ■ R(9 2 ,9 1 U 9 2 ) 
+ m h (9 2 U9 3 )-R(9 2 ,9 2 U9 3 ) 



« 0.17 + (0.3489 • 0.9885) + (0.0022 • 0.5658) 
= 0.17 + 0.3449 + 0.0012 = 0.5161 



because 

R(9 2 ,9 1 Lifts) 



0.17 + 0.001 • 2 

(0.00 + 0.001 • 2) + (0.17 + 0.001 • 2) 
0.9885 



R(9 2 ,9 2 U 0 3 ) 



0.17 + 0.001 • 2 

(0.17 + 0.001 • 2) + (0.13 + 0.001 • 2) 
0.5658 



and also 

m h (i )(9 3 ) = m(9 3 ) +m h (9 1 Ll9 3 ) ■ R(9 3 ,9 1 U9 3 ) 

+ m h {9 2 U0 3 ) -R(9 3 , 9 2 U0 3 ) 

« 0.13 + (0.3489 • 0.9851) + (0.0022 • 0.4342) 
= 0.13 + 0.3437 + 0.0009 = 0.4746 



Table IV 

Experimental results of HPR for Example 2 (e = 0 . 001 ) 



Focal elements 


m h(k) (") " approximate baa 


k = 3 


k = 2 


k = 1 


81 


0.0000 


0.0000 


0.0092 


62 


0.1700 


0.1700 


0.5141 


83 


0.1300 


0.1300 


0.4746 


61 U 62 


0.2000 


0.3489 


0.0000 


81 U 83 


0.2000 


0.3489 


0.0000 


62 U 6s 


0.0000 


0.0022 


0.0000 


61 U 62 U 6s 


0.3000 


0.0000 


0.0000 



When using k — l — x approach, the results are in Table V. 



Table V 

Experimental results of k — l — x for Example 2 



Focal elements 


m(-) obtained by k — l — x | 


k = l = 6 


k = l = 3 


81 


0.0000 


0.0000 


62 


0.1700 


0.0000 


63 


0.1300 


0.0000 


61 U 62 


0.2000 


0.2857 


8 i U 83 


0.2000 


0.2857 


62 U $3 


0.0000 


0.0000 


61 U 62 U 6s 


0.3000 


0.4286 
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C. Example 3 

Let’s consider the following bba: 

m{9 r) = 0, to( 6 > 2 ) = 0, m(0 3 ) = 0.70, 

m( 6 *i U 6 * 2 ) = 0, m{9\ U 9 3 ) = 0, 
m(9 2 U 0 3 ) = 0, to (6 *i U 6* 2 U 6* a ) = 0.30 



In this example, the mass assignments for all the focal ele- 
ments with cardinality size 2 equal to zero. For HPR, when 
e > 0 , to( 6* 2 116 * 3 ) will be divided equally and redistributed to 
{ 6 *i U 6 * 2 }, { 6*1 U 03 } and {9 2 U 6 * 3 }. Because the ratios are 



R(9 1 U 6 * 2 , X(3)) = f?( 6 »i U 6 * 3 , X(3)) = R(9 2 U 6 * 3 , X (3)) 
0.00 + 0.001-3 = 0 _ 3333 



(0.00 + 0.001 • 3) • 3 



For HPR, when e = 0, it can not be executed directly. This 
can show the necessity for the using of e. 

The bba’s obtained through HPR e= o.ooi at different steps 
are listed in Table VI 



Table VI 

Experimental results of HPR for Example 3 (e = 0.001) 



Focal elements 


rn h(k) (’) " approximate baa 


k = 3 


k = 2 


k = 1 


G 


0.0000 


0.0000 


0.0503 


02 


0.0000 


0.0000 


0.0503 


03 


0.7000 


0.7000 


0.8994 


61 U 62 


0.0000 


0.1000 


0.0000 


01 U 03 


0.0000 


0.1000 


0.0000 


62 U 0 s 


0.0000 


0.1000 


0.0000 


0 \ U 62 U $3 


0.3000 


0.0000 


0.0000 



When using k — l — x approach, the results are in Table VII. 



Table VII 

Experimental results of k — l — x for Example 3 



Focal elements 


m(-) obtained by k — l — x | 


k = l = 6 


k = l = 3 


0i 


0.0000 


0.0000 


02 


0.0000 


0.0000 


@3 


0.7000 


0.7000 


9 \ U 62 


0.0000 


0.0000 


81 U 83 


0.0000 


0.0000 


62 U 0 s 


0.0000 


0.0000 


0 \ U 62 U 0 s 


0.3000 


0.3000 



D. Example 4 (vacuous bba) 

Let’s consider the following bba: 

m(9i) = 0, m(9 2 ) = 0, m(9 3 ) = 0, 

m(9i U 6 * 2 ) = 0, to(6*i U 6 * 3 ) = 0, 

m(9 2 U 6 * 3 ) = 0, m( 6 *i U 6*2 U 6 * 3 ) = 1 

In this example, the mass assignments for all the focal el- 
ements with cardinality size less than 3 equal to zero. For 
HPR, when e > 0, m( 6 *i U 6*2 U 9 3 ) will be divided equally 
and redistributed to { 6*1 U 6 * 2 }, {9\ U 6 * 3 } and { 6*2 U 9 3 }. 



Similarly, the mass assignments for focal elements with 
cardinality of 2 obtained in intermediate step will be divided 
equally and redistributed to singletons. This is due to e > 0. 

For HPR, when e = 0, it can not be executed directly. This 
can show the necessity for the using of e. The bba’s obtained 
through HPR e= o.ooi at different steps are listed in Table VIII. 

Table VIII 

Experimental results of HPR for Example 4 (e = 0.001) 



Focal elements 


m h(k)(’) " approximate baa 


k = 3 


k = 2 


k = 1 


01 


0.0000 


0.0000 


0.3333 


02 


0.0000 


0.0000 


0.3333 


03 


0.0000 


0.0000 


0.3333 


0 \ U O2 


0.0000 


0.3333 


0.0000 


01 U 03 


0.0000 


0.3333 


0.0000 


O2 U 0 s 


0.0000 


0.3333 


0.0000 


0 \ U O2 U 0 s 


1.0000 


0.0000 


0.0000 



When using k — l — x approach, the results are in Table IX. 



Table IX 

Experimental results of k — l — x for Example 3 



Focal elements 


m(-) obtained by k — l — x 1 


k = l = 6 


CO 

II 

II 

•44 


0i 


0.0000 


0.0000 


02 


0.0000 


0.0000 


03 


0.0000 


0.0000 


0 \ U O2 


0.0000 


0.0000 


01 U 03 


0.0000 


0.0000 


O2 U 0 s 


0.0000 


0.0000 


0 \ U O2 U 0 s 


1.0000 


1.0000 



From the results of Example 1 - Example 4, we can see 
that based on k — l — x, the users can control the number of 
focal elements but can not control the maximum cardinality 
of focal elements. Although based on k — l — x, the number 
of focal elements can be reduced, the focal elements with big 
cardinality might also be remained. This is not good for further 
reducing computational cost and not good for human to catch 
the meaning. 

E. Example 5 

More generally, an approximation method 1 (giving TOi(.)) 
is considered better than a method 2 (giving TO 2 (.)) if both 
conditions are fulfilled: 1) if Jousselme’s distance of to i(.) 
to original bba m(.) is smaller than the distance of m 2 (.) 
to original bba to(.), i.e. < d(m 2 ,m)\ 2 ) if the 

approximate non-specificity value U(m{) is closer (and lower) 
to the true non-specificity value U(m) than U(m 2 ), where 
Jousselme’s distance is defined in [16], and non-specificity 

[17] is given by U(m) = m(A) log 2 |+|. 

Ace 

In this example, we make a comparison between HPR 
(method 1) and A '-additive approach (method 2). We consider 
the FoD 0 = { 6 * 1 , 6 * 2 , 6 * 3 , 6 * 4 , 6 * 5 } and we generate randomly 
L = 30 bba’s by using the algorithm given below [15]: 

Input: 0 : Frame of discernment; 

N max : Maximum number of focal elements 

Output: Bel: Belief function (under the form of a bba, to) 

Generate the power set of 0: V(&)\ 
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Generate a random permutation of V(Q) 'R ((-))', 

Generate a integer between 1 and N max — > k; 

FOReach First k elements of R ( 0 ) do 
Generate a value within [0, 1] —> m' k ; 

END Normalize the vector m'(.) = [m' x , ...,m' k \ — > m(.) 
(that is m(A k ) = mk)', 

Algorithm 1: Random generation of bba. 

We compute and plot d{rn\,rn), dim^rn), U(m), U(m{) 
and [7 (m 2 ) for several levels of approximation for j = 
1,2, ... ,L (where j is the index of the Monte-Carlo run). The 
results are shown in Fig. 3 and indicate clearly the superiority 
of HPR over the fc-additive approach. 



Max size of focal element =4 Max size of focal element =3 Max size of focal element =2 









Figure 3. Illustration of Example 5. 



We further use the Normalized Mean Square Error (NMSE) 
statistics defined by 



NMSEi = 

^ 3=1 



( U(m { ) — U(m )) 
Var(e*j) 



03) 



to evaluate the global quality of the approximation of the non- 
specificity by HPR (if i = 1) and by /.'-additive method (if i = 
2). ei = [ej ej , ... , ef] is the approximation error vector 
of method #i where = U(m 3 i ) — U(m), for j = 1, ...,L. 
Var(ej) is the variance of e r . The NMSE results are given in 
Table X below. 



Table X 

NMSE RESULTS OF EXAMPLE 5 



Max size of focal element 


4 


3 


2 


k-additive method 


3.9003 


21.8118 


69.0191 


HPR method 


3.9003 


19.0264 


61.9468 



Table X shows that HPR outperforms /e-additive method 
since it provides a lower NMSE, which means that in terms 
of information loss, HPR is better (it generates less loss) than 
the fc-additive approximation method. 



VI. Conclusions 

We have proposed a new interesting and useful hierarchical 
method, called HPR, to approximate any bba. The non- 
specificity degree can be easily controlled by the user. Some 
examples were provided to show how HPR works, and to show 
its rationality and advantage in comparison with some well- 
known bba approximation approaches. In future works, we 
will compare this HPR method with more bba approximation 
methods. In this paper, we have used only the distance of 
evidence and non-specificity as performance criteria. We plan 
to develop a more efficient evaluation criteria for capturing 
more aspects of the information expressed in a bba to measure 
the global performances of a method, and to design a better 
bba approximation approach (if possible). 
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